Time-delayed feedback control of a flashing ratchet 
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Closed-loop or feedback control ratchets use information about the state of the system to operate 
with the aim of maximizing the performance of the system. In this paper we investigate the effects 
of a time delay in the feedback for a protocol that performs an instantaneous maximization of the 
center-of-mass velocity. For the one and the few particle cases the flux decreases with increasing 
delay, as an effect of the decorrelation of the present state of the system with the information that the 
controller uses, but the delayed closed-loop protocol succeeds to perform better than its open-loop 
counterpart provided the delays are smaller than the characteristic times of the Brownian ratchet. 
For the many particle case, we also show that for small delays the center-of-mass velocity decreases 
for increasing delays. However, for large delays we find the surprising result that the presence of 
the delay can improve the performance of the nondelayed feedback ratchet and the flux can attain 
the maximum value obtained with the optimal periodic protocol. This phenomenon is the result 
of the emergence of a dynamical regime where the presence of the delayed feedback stabilizes one 
quasiperiodic solution or several (multistability), which resemble the solutions obtained in the so- 
called threshold protocol. Our analytical and numerical results point towards the feasibility of an 
experimental implementation of a feedback controlled ratchet that performs equal or better than its 
optimal open- loop version. 

PACS numbers: 05.40.-a, 02.30.Yy 



I. INTRODUCTION 

The ratchet effect consists of the emergence of a di- 
rected transport in a spatially periodic system out of 
equilibrium through the introduction of an external per- 
turbation. The celebrated ideas of rectifying thermal 
noise, originally introduced by Smoluchowski [l| and later 
resumed by Feynman [2j , were explicitly used in the con- 
text of directed transport in the 1990s 0, 0, Since 
then, these systems have been studied due to its impor- 
tance from a theoretical point of view in nonequilibrium 
physics 0] and its applications to many other fields such 
as condensed matter or biology @, 0] • 

One of the main ratchet types are the flashing ratch- 
ets that operate switching on and off a spatially peri- 
odic asymmetric potential. A simple periodic or random 
switching is able to achieve a rectification of thermal fluc- 
tuations and produce a net current of particles. Recently, 
a new class of control protocols that use instant informa- 
tion about the state of the system to take the decision 
of switching on or off have been introduced [§[. These 
so-called closed-loop or feedback control protocols have 
been proven to be an effective way to increase the net cur- 
rent in collective Brownian ratchets [1, 0, [l(| ■ Feedback 
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control can be imp lemented in systems where particles 
are monitored [111 [12| . This monitoring gives informa- 
tion about the position of the particles that can be used 
to switch on or off the potential in real time according 
to a given protocol. For instance, in Ref. [ll[ the motion 
of colloidal particles induced by a sawtooth dielectric po- 
tential, which is turned on and off periodically, is exper- 
imentally studied monitoring the particles. This sug gest 
that a feedback controlled version of the ratchet in 
can be constructed gathering information about the state 
of the system with a charge coupled device (CCD) cam- 
era and using this information to decide whether to turn 
on and off the potential in real time. In addition, feed- 
back ratchets have been recently suggested as a mecha- 
nism to explain the stepping motion of the two-headed 
kinesin (l3| . 

All Brownian feedback ratchets considered until now 
use instant information to operate, that is, they all mea- 
sure the state of the system and act instantaneously ac- 
cording to that measurement. However, in realistic de- 
vices there is always a time delay between the input mea- 
surements and the output control action due to physical 
limitations to the velocity of transmission and process- 
ing of the information [14l. Il5|. For example, in the con- 
struction of the feedback controlled version of the ratchet 
in time delays in the feedback will be present due to 
the finite time needed to take a picture with a CCD cam- 
era, transmit it, process it, and implement the resulting 
decision of switching on or off the potential. Therefore it 
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is important to compute the effects of time delays in the 
feedback, because it clarifies in which real ratchet sys- 
tems it is experimentally feasible to obtain the increase 
of velocity predicted in Q. The study of time-delayed 
feedback is also relevant because it appears naturally in 
many stochastic processes, such as complex systems with 
self- regulating mechanisms 0, [l?} ■ For another type of 
ratchets, deterministic feedback ratchets, some of the ef- 
fects of time delay in the feedback have been studied 

mm. 

In the current paper we investigate how a time de- 
lay in the control of a feedback flashing ratchet affects 
the net flux. In the next section we describe the ratchet 
model with the time-delayed feedback control policy. In 
Sec. IIIII we study in detail the case of one particle, get- 
ting an effective potential description for the flux in the 
relevant case of small time delays. We also present an al- 
ternative approach to understanding the dependence of 
the flux with time delay in terms of the covariance, and 
we describe the behavior for large delays. In Sec. IIVI we 
treat the collective ratchet with few particles and relate 
its center-of-mass velocity with the one particle flux pre- 
viously studied. In Sec. [V] we study the many particle 
ratchet, which exhibits a somehow counterintuitive be- 
havior; first we briefly review the results for zero delays 
that will be useful, and thereafter we expose the results 
in the two dynamical regimes of small delays and large 
delays. Finally, all the results are summarized and dis- 
cussed in Sec. IVH 



(a) 



II. MODEL 

We consider TV overdamped Brownian particles at tem- 
perature T in a ratchet potential V(x). The force act- 
ing on the ith particle at position Xiit) is a(t)F(xi(t)), 
where F(x) = — V'(x) and a(t) implements the action of 
the controller. Therefore the system dynamics is defined 
by the Langevin equations 

yx i (t) = a(t)F{x i (t))+£ i (t); i = l,...,N, (1) 

where 7 is the friction coefficient (related to the diffusion 
coefficient D through Einstein's relation D = k B T/^f) 
and £j(t) are Gaussian white noises of zero mean and 
variance (&(*)£,■(*')) = 2 1 k B T5 %3 8{t - t'). 

In order to study the effects of time-delayed feedback 
controls let us include a time delay of value r in the 
control of the paradigmatic maximization of the center- 
of-mass instant velocity protocol § . The controller mea- 
sures the sign of the net force per particle 



1 N 



(2) 



and, after a time r, it switches on the potential (a = 1) 
if the net force was positive or it switches off (a — 0) if 





FIG. 1: Panel (a): 'Smooth' potential © for 
Vq = 5k B T. Panel (b): 'Sawtooth' potential g]) for 
Vq = 5k B T and a = 1/3. Units: L = 1, k B T = 1. 



it was negative. Thus the control protocol reads 



a(t) 



h(f(t-r)) 
1° 



if t > t, 
otherwise, 



(3) 



with 9 the Heaviside function [Q(x) = 1 if x > 0, else 

e(x) = o]. 

Finally, to completely fix the model we choose a piece- 
wise linear sawtooth potential V(x) — V(x + L) of height 
Vq and asymmetry parameter a < 1/2, 



V(x) = 




T/ Vq I x 



if < § < a, 
if a< f < 1. 



(4) 



We have verified that the results found in this paper are 
valid for other potentials provided they have the same 
height of the potential Vq and the same asymmetry pa- 
rameter a, with Vq defined as the difference between the 
maximum and the minimum values of the potential and 
ah as the distance between the minimum and the maxi- 
mum positions. For this verification we have considered 
the 'smooth' potential 



V{x) 
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(5) 



which has potential height Vq, period L, and asymmetry 
a = 1/3. See Fig. [Q 

In the study of these feedback ratchets it proves to be 
useful to distinguish three cases: one particle, few par- 
ticles, and many particles. This classification is based 
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on the results of the zero delay studies US, [3, 

which 

revealed different characteristics and analytical approxi- 
mations for each case. The many particle case is formed 
by those feedback collective ratchets that for zero delay 
have net force fluctuations smaller than the maximum 
absolute value of the net force; see Refs. [1, S, Ell- 

Throughout the rest of this paper, we will use units 
where L — 1, ksT — 1, and D = 1. 



without delay 8], i.e., 



JO if < x < a, 
foW = U i£a<x<l. 



(7) 



In terms of the force @ , the evolution of the position of 
the particle obeys the stochastic delay differential equa- 
tion 



III. ONE PARTICLE 

In this section we discuss the simpler case of a ratchet 
consisting of one particle, so that the position x(t) is gov- 
erned by Eq. fU with N — 1 and a(t) given by Eq. 
which is a nonlinear stochastic delay differential equa- 
tion. In general, there is no analytical treatment for these 
time-delayed stochastic equations. Here, we shall write 
the corresponding delay Fokker-Planck equation [2(| , and 
use a perturbative technique [13, HU to obtain an effec- 
tive potential description for small delays that leads to 
approximate analytical expressions for the flux. Finally, 
in this section we shall get insight in the regime of large 
delays by studying the covariance of the sign of the net 
force. 

The force that the particle feels with the inclusion of 
the time delay t in the control [Eq. ©] depends both on 
the actual position x := x(t) and on the delayed position 
x T := x(t — t). This force F T (x,x T ) is periodic in both 
arguments, F T {x,x T ) = F T (x + l,x T ) = F T {x,x T + 1), 
and reads 



x{t) = F T {x(t),x{t - t)) + £(t). 



(8) 



F T (x, x T ) — 



' if < x T < a, 
^ if a < x T < 1 and < x < a, 
if a < x T < 1 and a < x < 1. 



(G) 



l-o 



In particular, F T {x,x) —: Fq(x) corresponds to the ef- 
fective force of the instant maximization control protocol 



The probability density p(x,t) of this stochastic process 
satisfies a delay Fokker-Planck equation [l?], H3, H2| , 
which involves the two-point probability density as fol- 
lows: 



^p(x,t) = -^ J F T (x,x T )p(x,t;x T ,t - t) dx T 
d 2 



(9) 



For small delays, this equation can be treated perturba- 
tively; then, following Refs. [13, HH, the explicit effective 
force for small delays can be achieved by computing 

F c ?((x) — J F T (x, x T )P(x T , t + t\x, t) dx T , (10) 

where the short time propagator P(x, t+r\x, t) (see §4.4.1 
in Ref. (H) is 



P{x T ,t + t\x, t) 



: exp 



[x T - x - F q (x)t] 
It 



(11) 

Due to the Gaussian form of the propagator in this small 
delay approximation, we can neglect the long tails of 
the Gaussian propagator and restrict the integration in 
Eq. (fTU)) to the intervals (a — 1, 1) and (0, 1 + a) for 
< x < a and a < x < 1, respectively. We get 



F eS (x) = F cS (x + 1) = 



2« 



erfC (^) +Crfc fe 



2(l-a) 



2 — erfc 



/2t 



erfc 



x — a+ 



V2t 



if < x < a, 
if a < x < 1, 



(12) 



where erfc(x) is the complementary error function. On 
the other hand, the value of the effective force can be 
computed numerically by splitting in bins the position 
of the particle and evaluating the probability of being 
in those bins. For small delays, Eq. (fT2|) gives a good 
estimation as shown in Fig. [2j 

The main effect of the inclusion of a small delay in the 
control is a slant of the effective force near the points of 
discontinuity. This effect lies on the idea that the closer 



the particle is to the discontinuities, the more probable is 
that the controller makes a mistake. For instance, when 
the particle is to the left of x = a and close to it, there 
are two possibilities: (i) if the retarded position was to 
the left too then the controller sets the potential off, and 
(ii) if the retarded position was to the right then the 
controller sets the potential on and the particle feels a 
negative force — Vb/a. Therefore in the points to the left 
of x = a and close to it the force takes an effective value 
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FIG. 2: Effective force for small delays for potential 
height Vq = bksT and asymmetry a = 1/3 in the one 
particle case [Eq. (JT2J)]. Units: L = 1, D = 1, fc B T = 1. 

between and — Vb/et, resulting in a negative effective 



force. 

In this effective description the position of the particle 
evolves with a Langevin equation x(t) — F e g(x) + £(£), 
with the associated (nondelayed) effective Fokker-Planck 
equation 

d d d 2 

— p(x, t) = -— [p{x, t)F e g(x)] + P(x, t), (13) 

with periodic boundary conditions. The average velocity 
is obtained computing the expectation value of the veloc- 
ity in the stationary distribution of the effective Fokker- 
Planck equation [f|: 

1 _ e Vcf f (i)-v C ff(o) 

(x) = — i xi , (14) 

f*dx J* + dy e ^«(y)-K«(x) ' 

where V e g (x) — — f Q F c ff(s) ds. Integrating F c g (x) we 
get the expression of the approximate effective potential 
for small delays V c g(x), 



V eS (x) = 



VoV2t 
2a 



2(l-a) 



ierfc (;&) + ierfc (j?) " ierfc (tf) ~ 7S 



if < x < a, 



2{a-x) 



ierfc 



- ierfc 



2r 
x— a+ 



— ierfc 



l-a- 



/2t 



ierfc 



V„T 



/2t 



2(l-«); 



ierfc 



/2r 



2r 
2(l-a) 



(15) 



if a < x < 1 , 



in the interval [0, 1], and outside V e g(x) = V e g(y) + (x — 
y)V e g(l), with y = x mod 1, y € [0,1]. The function 
ierfc is the first iterated integral of the complementary 
error function |24|. 



ierfc(x) = / erfc(s) ds = —x erfc(x) 



(16) 



This effective potential is depicted in Fig. [3l where we see 
that an increase of the delay implies a decrease of the av- 
erage tilt of the potential. Eventually, the stationary flux 
is calculated inserting Eq. (fT5"]) in Eq. (fT4"| . The result- 
ing approximate expression gives good results for very 
small delays and a good estimate of the decrease rate for 
small delays. See Fig. |4j [This can be understood not- 
ing that although for some positions the corrections to 
the effective force are appreciable already for quite small 
delays (see Fig. ^ this only happens in small space in- 
tervals and therefore the results for the flux are better 
than expected.] The approximate analytical expression 
obtained gives the average velocity in terms of the main 
magnitudes of the system, namely, the height of the po- 
tential Vq, its asymmetry a, and the time delay in the 
feedback r. We have checked that this result is in good 



agreement also for other potentials. 

Another approach can be taken to understand the ob- 
served decrease in the flux for increasing delay. The 
instant maximization protocol does not use detailed in- 
formation about the position of the particles, it simply 
deals with the sign of the net force, namely, sgn/, [with 
sgn(x) = 1 for x > 0, sgn(x) = for x = 0, and 
sgn(x) = — 1 for x < 0]. The flux performance of the 
protocol would be optimal if it would have received the 
present sign of the net force, sgn/(t), but it does re- 
ceive its value a time r earlier, sgn/(i — r). This earlier 
value contains information about the present value be- 
cause both values are correlated, as can be shown com- 
puting the covariance 



(17) 



C(r) :=([sgn/(t) - /#gn/(* -r) - fx] 



where 



C(t) :=<sgn/(t)sgn/(f-r)), 



(18) 



p :=<sgn/(t)) = (sgn/(t-r)>. 
The decrease of the function C(r) for increasing t (Fig. [5]) 
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FIG. 3: Effective potential [Eq. (JTHD] for potential 
height Vo = 5k bT and asymmetry a = 1/3 for time 
delays r = 0, 1CT 4 , 1CT 3 , and 10" 2 . Units: L = 1, 
D = 1, k B T = 1. 





numerical results 




small delay approx. 


1 
\ 

\\ 
\\ 


approx. using ( '(-) 


\\ 
- \ \ 

\ \ 

\ \ 

\ \ 
\ \ 

X N 
\-\ 





0.05 



0.1 

x 



0.15 



0.2 



FIG. 4: One particle flux vs delay. The numerical result 
(solid line) is compared with the estimations using the 
effective potential (fT5j) (dashed line) and using C(r) 
(dotted line). Vo = bk B T and a = 1/3. Units: L = 1, 
D = 1, k B T = 1. 



explains the decrease of the center-of-mass velocity as a 
consequence of the loss of information about the present 
sign of the net force. In addition, we can obtain an es- 
timation of the flux decrease with the following heuristic 
argument. Let us calculate the covariance using 



C = P++ 
A 4 = P++ 



P— - P+- - P-+, 
P— + P+- - P-+, 



(19) 



where Pjj is the joint probability of having a positive 
(i = +) or negative (i = — ) net force at time t and a 
positive (j = +) or negative (j = — ) net force at time 
t — r. These probabilities can be computed if we assume 
that the system performance can be explained with the 
simplified description that sgn/(i — r) is different from 
sgn/(i) with probability p. This description allows us 
to use the results found in 1251 for the instantaneous 



maximization protocol with a controller receiving sgn/(£) 
through a noisy channel with noise level p. In fact, notice 
that the plot of the effective potential (Fig. [3]) resembles 
the form of the effective potential found in Ref. [25[ for 
the noisy channel. This elementary description gives the 
values P-+ = bp, P__ = 6(1 - p), P + _ = (1 - b)p 
and P++ = (1 — 6)(1 — p) for the joint probabilities, 
with b the probability of sgn/(i) being negative. Thus 
Eqs. (p~9|) can be rewritten in terms of the probability of 

error p = P^ + P |_ and the probability b = P |- + P_ _ 

as 



C w 1 - 2p, 
fi re 1 - 2b. 



(20) 



In [25j it is shown that for small potential heights (small 
Vq) 6 ~ a and 

(x) w V (l - 2p). (21) 

Therefore this simplified description suggests 

(x) ~ V C. (22) 

For larger potential heights, a better estimation is 
obtained evaluating the general expression (x)(p) of 
Ref. [H at p(r) = [1 - C(r)]/2. This estimation is plot- 
ted in Fig.|U where it is compared with numerical results 
and the analytical small delay approximation [Eqs. (|14|) 
and f[5)|]. 

The average velocity of the particle for large delays 
is not zero, but reaches a constant value independent of 
the delay (see Fig. @| ■ We have seen that the function 
C(t) also tends to a constant nonzero value in the same 
characteristic time that the velocity does, in qualitative 
agreement with the estimation described after Eq. (|22p . 
although this estimation does not give the correct value 
of the flux. Therefore this estimation gives good quan- 
titative results for small delays and the qualitative be- 
havior for large delays. The large r behavior observed 
for the flux implies an effective force independent of the 
time delay r for large enough values of r, as we show 
in Fig. [5] The average over x of the numerical large r 
effective force is positive, in agreement with the positive 
net flux obtained. For example, for asymmetry parame- 
ter a = 1/3 and potential heights Vo = 1, 5, and 10, the 
net flux is (i) T _ +00 sa 0.01, 0.12, and 0.18, respectively. 
The convergence to this constant value can be under- 
stood realizing that the covariance C becomes negligible 
for large delays, i.e., the fluctuations of sgn/ around its 
mean value at t and at t — r are independent. This in- 
dicates that the system dynamics is effectively the same 
as that for an open-loop control protocol, as the corre- 
lation between the switches and the state of the system 
are negligible. 

Comparing the results for the delayed instant maxi- 
mization protocol with the optimal periodic open-loop 
protocol, we see that the former performs better than 
the latter even for nonzero delay, provided the delay is 
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FIG. 5: Covariance C [Eq. (|17p] as a function of the 
time delay for potential heights Vq = ksT , 5ksT, and 
lOksT. Asymmetry parameter a — 1/3. Units: L = 1, 

b = l, /s B r = l. 



FIG. 7: Center-of-mass velocity as a function of the 
time delay for number of particles N — 1, 10, 50, and 
100. Parameters of the potential: Vq — 5kgT and 
a = 1/3. Units: L = 1, D = 1, fc B T = 1. 
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FIG. 6: Effective force (from numerical simulations) 
(N = 1) for several time delays. Vb = hksT and 
a = 1/3. Units: £ = 1, D = 1, fc B T = 1. 



smaller than the characteristic times of the dynamics of 
the Brownian ratchet. Therefore the instant maximiza- 
tion protocol gives a larger flux than the optimal open- 
loop control protocol for time delays r such that r <C T on , 
t <C T ff, where T on ~ (1 — a) 2 /Vb and T a s ~ a 2 /2 are 
the on-potential and off-potential times in the optimal 
periodic protocol [5J]. See, for example, Fig. [5] and com- 
pare with (i)opon ~ 0.3 that is the value for the optimal 
periodic protocol for Vo — 5 and a = 1/3, which has 
T on « 0.06 and T oS « 0.05. 



IV. FEW PARTICLES 

In this section we deal with a collective ratchet com- 
pounded of a few particles. We will show that the center- 
of-mass velocity for the few particle case can be related 
with the velocity obtained for the one particle ratchet 



studied in the section before. 

As in the one particle case, the effect of the inclusion of 
a delay is a decrease in the covariance and in the center- 
of-mass velocity (Fig. [7]). Therefore we can also interpret 
the decrease in the center-of-mass velocity as a conse- 
quence of the loss of information of the present sign of 
the net force, and then assume that the system perfor- 
mance can be explained with the simplified description 
that sgn/(f — r) is different from sgn/(t) with probabil- 
ity p. This simplified description leads for small potential 
heights [H, [If to 



C n (t) ~ l-2p N , 
H N ~ 1 - 2b N , 

U (l - 2pn) 



\Xcm/N 



VoCn 



(23) 



^/27ra(l - a)N y/2ira(l - a)N ' 



where the subscript N denotes that the quantities are 
the values in the case of N particles. We have numeri- 
cally found that the function Cjv(t) is approximately the 
same for any number of particles in this regime of a few 
particles, and Cm ~ C. Thus we have the relation 



IN 



(r) 



(x)(t) 



^J2ita{\ - a)N 



(24) 



between the velocities for one and for N particles for a 
given delay r. This Eq. (|24|) gives good results for small 
values of the delay. In particular, inserting Eq. (TTJJ in 
Eq. (|24[) we obtain an analytical approximate expression 
for the case of few particles in the regime of small delays. 

We stress that, analogously to the zero delay case jg], 
the main effect of having a collective ratchet is a de- 
crease in the magnitude of the force fluctuations. This 
fact gives a center-of-mass velocity inversely proportional 
to the square-root of the number of particles, as Eq. (|24|) 
states. Thereby, if the number N of particles increases, 
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there will be a decrease of the values of the delay that 
give better performances for the delayed instant maxi- 
mization protocol than for the optimal periodic protocol. 

On the other hand, for large time delays the analogy 
between the delayed protocol and the noisy channel pro- 
tocol no longer gives a good estimate. In this regime of 
large delays the covariance C(r) = C(r) — /i 2 becomes 
negligible indicating that sgnf(t — r) and sgn/(t) are 
nearly uncorrelated and that the system effectively be- 
haves as if it were driven by an effective open-loop con- 
trol protocol. In addition, we observe that the value of 
the center-of-mass velocity becomes independent of the 
number of particles (see Fig. [7]). This is a hallmark of col- 
lective open-loop control ratchets, in which the absence 
of feedback decouples the Langevin equations provided 
the particles do not explicitly interact with each other. 



V. MANY PARTICLES 

We study here the effects of time delays in the feed- 
back controlled Brownian ratchet described in Sec. ITU for 
the many particle case, considering both the 'smooth' po- 
tential and the 'sawtooth' potential for various potential 
heights and different initial conditions. 

We find that the system presents two regimes sepa- 
rated by a delay r m i n for which the center-of-mass ve- 
locity has a minimum; see Fig. [5J In the small delay 
regime (r < T m - m ) the flux decreases with increasing de- 
lays as one could expect. On the contrary, in the large 
delay regime (r > T m - m ) we have observed and explained 
a surprising effect, namely, the center-of-mass velocity 
increases for increasing delays and the system presents 
several stable solutions. We have found that this critical 
time delay r m j n is inversely proportional to the potential 
height r m j n oc I/Vq with a proportionality constant that 
mildly depends on the number of particles. 



A. Zero delay 

The many particle ratchet in absence of delay (i.e., r = 
in the model of Sec.flT} has been studied in Ref. [8(. It 
has been shown that the net force per particle exhibits a 
quasideterministic behavior that alternates large periods 
of time t on with f(t) > (on dynamics) and large periods 
of time tog with f(t) < (off dynamics). The center-of- 
mass velocity can be computed as 



Axfto n ) 

^on ~t~ ^off 



with 



Ax(t on ) = Ax on [l 



-ton/(2At on )l 



(25) 



(26) 



where Acc on and At on are obtained fitting the displace- 
ment during the 'on' evolution for an infinite number of 
particles (see Ref. [10( for details). 
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FIG. 8: Many particle case: Center-of-mass velocity as 
a function of the delay (for large delays only the first 
branch is represented here) , and comparison with the 
results obtained with the threshold protocol and with 

the large delay approximation Eq. ([55)) . For the 
'smooth' potential © with V Q = 5k B T and N = 10 s 
particles. Units: L = 1, D = 1, fcsT = 1. 



On the other hand, for many particles the fluctuations 
of the net force arc smaller than the maximum value of 
the net force (see Fig. [3]). This allows the decomposition 
of the dynamics as the dynamics for an infinite number 
of particles plus the effects of the fluctuations due to the 
finite value of N. The late time behavior of the net force 
f(t) for an infinite number of particles is given for the on 
and off dynamics by 0] 



f™(t)=C v e 



-A„(i- 



with v = on, off. 



(27) 



The coefficients C„, A„, and t„ can be obtained fitting 
this expression with the results obtained integrating a 
mean field Fokker-Planck equation obtained in the limit 
N — > oo and without delay; see Refs. H, 03 for details. 
For a finite number of particles the fluctuations in the 
force induce switches of the potential and the times on 
and off are computed equating f£° to the amplitude of 
the force fluctuations, resulting in [8j 

t on + t oS = b + dlnN, (28) 

with b = C on + C ff and d = (A on + A ff)/(2A on A ff). 



B. Small delays 

For small delays, r < r nun , we observe that the flux 
decreases with the delay. See Fig. [5J We have seen that 
this decrease is slower than that found for the few parti- 
cle case (Sec. lIV[) . and that the expressions derived to de- 
scribe this decrease in the few particle case does not hold 
here. However, the decrease observed here can be under- 
stood noting that a change in the sign of f(t) is perceived 
by the controller a time r after, what delays the reaction 
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FIG. 9: Many particle case: Evolution of the net force 

with zero delay (r = 0) for the 'smooth' potential 
Eq. © with V = 5k B T and N = 10 5 particles. Units: 
L = 1, D = 1, k B T = 1. 



FIG. 10: Many particle case: Evolution of the net force 
with a small delay (r = 0.02) for the 'smooth' potential 
Eq. © with V = 5k B T and N = 10 5 particles. Units: 
L = 1, D = 1, k R T = 1. 



of the system and makes the tails of f(t) longer and im- 
plies an increase of the time interval between switches. In 
addition, the form of f(t) is less smooth than for no delay 
because the delayed reaction of the controller allows to 
have several sign flips in the f(t) tails before the system 
reacts. This sign flips give short epochs of fast switches 
of the potential (between long on and off epochs), which 
lead to large fluctuations in fit). These large fluctua- 
tions eventually destabilize these long period solutions 
for t ~ -r min . See Fig. [TUl 

As the main effect of the delay is to stretch the 'on' 
and 'off' times of the dynamics, using the many particle 
approximation |8j we can write 



ton + ^off + A 



b + d\nN + At' 



(29) 



where we have found that the increase of the length of 
the on-off cycle At is proportional to the delay At oc t. 
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FIG. 11: Many particle case: Evolution of the net force 
with a large delay (r = 0.12) for the 'smooth' potential 
Eq. © with U = 5k B T and N = 10 5 particles. Units: 
L= 1, D = 1, k B T = 1. 



C. Large delays 

After the minimum flux is reached for t = T m j n , the 
flux begins to increase with the time delay (see Fig. [H]). 
This increase is due to a change in the dynamical regime: 
for t > T m i n the present net force starts to be nearly 
synchronized with the net force a time t ago. This self- 
synchronization gives rise to a quasiperiodic solution of 
period T = t. Note that there is not a strict periodicity 
due to stochastic fluctuations in the 'on' and 'off' times. 
Looking at the fit) dependence, Fig. [TTJ we see that the 
solutions stabilized by the self-synchronization are simi- 
lar to those obtained with the threshold protocol d, [l(| • 
In Fig. [8] we show that the threshold protocol that has 
the same period gives similar center-of-mass velocity val- 
ues, confirming the picture. (Differences are due to the 
fact that we have considered for the threshold protocol 



simulations with on and off thresholds of the same mag- 
nitude, while Fig. [TT1 shows that the effective thresholds 
are different.) 

This picture allows one to understand the increase of 
velocity for increasing delay, and the presence of a maxi- 
mum. This maximum is related with the o ptim al values 
of the thresholds that have been shown in [lCj to give a 
quasiperiodic solution of period T = T on + T s, with T on 
and T g the optimal 'on' and 'off' times of the periodic 
protocol. Therefore if we know the values of T on and T s 
for the optimal periodic protocol [T on ~ (1 — a) 2 /Vb and 
Tog r~j a 2 /2] we can predict that the maximum of the 
center-of-mass velocity is reached for a delay 

%n + %S, (30) 

and has a value 

(^cm ) closed ( Tin ax ) — (^cm) open ' 
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FIG. 12: Many particle case: First three branches of 
stable solutions for the 'smooth' potential (O with 
V = 5k B T and N = 10 5 particles. Units: L = 1, D = 1, 
k B T = l. 



0.4 
0.35 

0.3 
0.25 

0.2 
0.15 

0.1 
0.05 




"D 

o 



Q_ 



small t 
x-branch 
x/2-branch 
x/3-branch 



0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 

x 

FIG. 13: Many particle case: Period T of the 
quasiperiodic solutions for small delays and for large 
delays. For large delays only the first three branches of 
stable solutions are shown. 'Smooth' potential ((5|) with 
V = 5k B T and N = 10 5 particles. Units: L = 1, D = 1, 
k B T = 1. 



with 



t-cm/opcn 



the center-of-mass velocity for the opti- 



mal open-loop protocol. Thus this expression gives the 
position and height of the maximum of the delayed feed- 
back control protocol in terms of the characteristic values 
of the optimal open-loop control. In particular, it implies 
that the position and height of the maximum for the flux 
is independent of the number of particles. 

As an example we can apply these expressions to the 
'smooth' potential with Vq = 5 that for the optimal pe- 
riodic protocol gives (i cm ) = 0.44 for T on = 0.06 and 
T g = 0.05, so we obtain r max = 0.06 + 0.05 = 0.11 in 
agreement with Fig. [5] 

For values of the delay of the order of or larger than 
r max quasiperiodic solutions of other periods start to be 



stable; see Fig. [12] The periods for the net force f(t) 
that are found are those that fit an integer number of 
periods inside a time interval t, verifying that the present 
net force is synchronized with the net force a time r ago, 
that is, the quasiperiodic solutions have periods T = t/2, 
T = t/3, ... In addition, it can be seen that the center- 



of-mass velocity of the n branch 



l cdi/t/)i 



period T 
through 



whose f(t) has 



t / n is related with that of the T = r branch 



r/n( T ) 



>r(r/n). 



(32) 



We highlight that several branches can be stable for the 
same time delay r. Whether the system finally goes to 
one or another stable solution depends on the initial con- 
ditions and on the particular realization of the noise. See 
Figs.[T2land[T3l For these branches we have found initial 
conditions that go to these solutions and that remain in 
them during several thousands of periods, indicating that 
they are stable solutions or at least metastable solutions 
with a large lifetime. 

The analogy with the threshold protocol allows one to 
use the analytic results of [l(| to get further insight in 
the numerical results. The behavior for large delays for 
the T = r branch can be obtained using the relation 



Ax(t) 



(33) 



with Ax(t) given by Eq. (f2"6"| . This equation gives a good 
prediction for the largest delays of the first branch (see 
Fig.©. 

On the other hand, for very large values of the delays 
of the first branch the solutions in a given branch start to 
become unstable, which can be understood noting that 
this happens when the fluctuations of the net force be- 
come of the order of the absolute value of the net force. 
Thus the maximum delay that gives a stable solution in 
the first branch is 



Tinst = ton + t oS = b + d 111 N, 



(34) 



where b and d are determined as in Eq. (|28[) . For example, 
for the 'smooth' potential with Vq — 5, which has b — 
-0.070 and d = 0.031, we obtain for N = 10 5 particles 
the value Ti nst = 0.29 in accordance with the numerical 
results shown in Figs. [51 and[T2l 

The previous results for the first branch, Eqs. (|33[) and 
([3~4"| . can be extended to other branches by direct appli- 
cation of the relation 



VI. CONCLUSIONS 

In this paper we have faced a fundamental question 
intrinsically related with feedback Brownian ratchets, 
namely, the effects of a time delay in such a feedback con- 
trolled stochastic system. We have focused on the task of 
studying the dependence of the flux with the time delay 
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for both the case of one particle and for the collective 
version of the ratchet with few particles. 

For one particle ratchets and small delays we have ob- 
tained an effective potential which contains the basic in- 
gredients that come into play, and gives an approximate 
analytical expression for the flux. The effects of the delay 
in the shape and the average slant of the effective poten- 
tial allows one to easily understand the decrease of the 
flux with increasing delays. The approximate analytical 
expression obtained [Eqs. (fH]) and (fT5|) ] gives the average 
velocity in terms of the main magnitudes of the system: 
the height of the potential Vo, its asymmetry a, and the 
time delay in the feedback r. In particular, it allows one 
to obtain predictions of the characteristic time scale of 
the decrease due to the delay. This relation is also useful 
in the few particle case thanks to the relation (|24p found 
between the flux for the one and the few particle cases. 

The decrease of the covariance of the sign of the net 
force for increasing delays provides an alternative ap- 
proach to understand the dependence of the flux with 
the delay. This approach has given the relation between 
the covariance and the flux, and has allowed us to relate 
the flux obtained in the few particle case with the results 
of the one particle case [Eq. ([24]) ]. In addition, the fact 
that the covariance becomes negligible for large delays 
indicates that the delayed control protocol effectively be- 
haves as if it were an open-loop control protocol. This 
results in a constant value of the flux for large delays that 
is independent on the number of particles. 

We want to stress as an important result of this paper 
that the feedback controlled system for one or few parti- 
cles is able to perform better than its open-loop counter- 
part even for nonzero time delays (provided the delays are 
smaller than the characteristic times of the dynamics of 
the Brownian ratchet). Furthermore, even for arbitrarily 
large delays the net flux does not vanish but it reaches a 
positive value, albeit it performs worse than the optimal 
open-loop protocol. We also highlight the importance of 
this study for realistic experimental situations that nec- 
essarily have to face with time delays. For the ratchet 
considered in [ll[ the colloidal particles have diameter 
0.25, 0.4, and 1 /im, and the sawtooth dielectric poten- 
tial has period L — 50 /im and asymmetry a ~ 1/3. The 
maximum velocities obtained with a periodic switching 
were reported [ll[ to be of 0.2 /im/s with T on ~ 30 s and 
T q ~ 50 s. As the trapping energy is significantly greater 
than kT and a ~ 1/3 the introduction of feedback can 
increase the velocity up to a factor (1/2 — a) -1 ~ 6 ap- 
proximately [g, [13J , attained when the time delay in the 
feedback is negligible. The results obtained in this paper 
indicate that for delays in the feedback smaller than the 
characteristic times of the system (of order 10 s, i.e., of 
order 10 -3 in the adimensional units used throughout our 
paper) it is possible to obtain velocities greater than the 
maximum of open-loop protocols. The use of a conven- 
tional CCD camera (30 fps) and conventional electronics 
is enough to achieve a feedback control performance with 
a time delay of the order of 0.1 s (10 -4 in adimensional 



units), for this time delay an increase of the velocity of a 
factor of 4 is expected. This points towards the feasibil- 
ity of implementing experimentally a feedback controlled 
ratchet that performs better than its optimal open-loop 
version. 

We have also studied the effects of time delays in the 
many particle case, where surprising and interesting re- 
sults arise. Although in the many particle case without 
delay the instantaneous maximization protocol performs 
worse than the optimal open-loop protocol, the introduc- 
tion of a delay can increase the center-of-mass velocity 
up to the values given by the optimal open-loop con- 
trol protocol. For small delays the asymptotic average 
velocity decreases for increasing delays, until it reaches 
a minimum. After this minimum, a change of regime 
happens and the system enters a selfsynchronized dy- 
namics with the net force at present highly correlated 
with the delayed value of the net force used by the con- 
troller. This self-synchronization stabilizes several of the 
quasiperiodic solutions that can fit an integer number of 
periods in a time interval of the length of the time de- 
lay. The stable quasiperiodic solutions have a structure 
similar to those solutions appearing in the threshold pro- 
tocol. This analogy has allowed us to make numerical 
and analytical predictions using the previous results for 
the threshold protocol [l(| • In particular, we have estab- 
lished the location and value of the maximum, and also 
the value of the time delay beyond which a quasiperiodic 
solution becomes unstable. The results obtained show 
that for most time delays several solutions are stable and 
therefore the systems present multistability; which sta- 
ble solution is reached depends on the past history of the 
system. The possibility to choose the quasiperiod of the 
solution we want to stabilize just tuning the time delay 
can have potential applications to easily control the par- 
ticle flux. Note that we can even leave some branch just 
going to time delays where the branch is already unsta- 
ble, and force the system to change to another branch of 
solutions. 

In summary, we have studied the effects of time de- 
lays in the feedback control of a flashing ratchet. The 
results for one and few particles point towards the fea- 
sibility of an experimental implementation of a feedback 
controlled ratchet that performs better than its optimal 
open-loop version. On the other hand, the many particle 
case presents an unexpected improvement of the flux due 
to the stabilization of one or more quasiperiodic solutions 
for large enough delays. 
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